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We study the optimal approximation of the solution of an operator equa- 
tion A{u) = / by linear mappings of rank n and compare this with the best 
n-term approximation with respect to an optimal Riesz basis. We consider 
worst case errors, where / is an element of the unit ball of a Hilbert space. 
We apply our results to boundary value problems for elliptic PDEs that are 
given by an isomorphism A : Hq{Q) H~^{i}), where s > and 0, is an 
arbitrary bounded Lipschitz domain in W^. We prove that approximation by 
linear mappings is as good as the best n-term approximation with respect 
to an optimal Riesz basis. We discuss why nonlinear approximation still is 
important for the approximation of elliptic problems. 
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1 Introduction 

We study the optimal approximation of the solution of an operator equation 
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(1) 
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where ^ is a linear operator 



(2) A:H^G 

from a Hilbert space H to another Hilbcrt space G. We always assume that A is 
boundedly invertible, hence (1) has a unique solution for any f E G. We have in 
mind, for example, the more specific situation of an elliptic operator equation, which 
is given as follows. Assume that C M*^ is a bounded Lipschitz domain and assume 
that 

(3) A : H'^in) H-'{n) 

is an isomorphism, where s > 0. A standard case (for second order elliptic boundary 
value problems for PDEs) is s = 1, but also other values of s are of interest. For this 
situation we take H = Hq{Q) and G = //"^(fi). Since A is boundedly invertible, 
the inverse mapping S : G H is well defined. This mapping is sometimes called 
the solution operator — in particular if we want to compute the solution u = S{f) 
from the given right-hand side A{u) = f. 

Let F be a specified normed (or quasi-normed) subspace of G. We use linear and 
nonlinear mappings Sn for approximating the solution u — A~^{f) for f & F. Let 
us consider the worst case error 

e{S^,F,H) = sup \\A-\f)-SM\\H. 

II/IIf<i 

For a given basis B — {hi \ i oi H we consider the class NniB) of all (linear or 
nonlinear) mappings of the form 



k=l 

where the and the ik depend in an arbitrary way on /. We also allow the basis B 
to be chosen in a nearly arbitrary way. Then the nonlinear widths e^°^(S', F, H) are 
given by 

e'^m ^' H) = inf inf e(5„, F, H). 

Here Be denotes a set of Riesz bases for H, where G indicates the stability of the 
basis, see Section 2.1 for details. These numbers are the main topic of our analysis. 
We compare nonlinear approximations with linear approximations. Here we consider 
the class of all continuous linear mappings Sn : F ^ H , 



i=l 
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with arbitrary hi ^ H. The worst case error of optimal hnear mappings is given by 

e^"(5,F,/7)= inf e{S^,F,H). 

The third class of approximation methods that we study in this paper is the class of 
continuous mappings C„, given by arbitrary continuous mappings Nn : F and 
: — > if. Again we define the worst case error of optimal continuous mappings 

by 

eT{S,F,H)^ mi e{Sn,F,H), 

where Sn — ^n° ^n- These numbers, or slightly different numbers, were studied by 
different authors, cf. [7, 8, 10, 24]. Sometimes the e^°°* are called manifold widths of 
S, see [8]. 

Remark 1. i) A purpose of this paper is to compare the numbers 

e^°5(5, F, H) with the numbers ej^''(5, F, H), where S : F ^ H is the restric- 
tion of : G ^ H to F <Z G. In this sense we compare optimal linear 
approximation of S (i.e., by linear mappings of rank n) with the best n-term 
approximation with respect to an optimal Riesz basis. 

ii) To avoid possible misunderstandings, it is important to clarify the following 
point. In the realm of approximation theory, very often the term "linear ap- 
proximation" is used for an approximation scheme that comes from a sequence 
of linear spaces that are uniformly refined, see, e.g., [6] for a detailed discus- 
sion. However, in our definition of e^^{S, F, H) we allow arbitrary linear 
not only those that are based on uniformly refined subspaces. In this paper, 
the latter will be denoted by uniform approximation scheme. 

For reader's convenience, we finish this section by briefiy summarizing the main 
results of this paper. 

• Theorem 1: Assume that F C G is quasi- normed. Then 

e-5(5,F,//) > ^hm{S,F,H) 

holds for all m > 4C^n, where bn{S, F, H) denotes the n-th Bernstein width 
of the operator S, see Section 2.2 for details. 

• Theorem 2 and Corollary 1: Assume that F C G is a Hilbert space and 

b2n{S,F,H)>^bn{S,F,H). 
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Then 

(5, F, H) = eTiS, F, H) x 6-^(5, F, H). 

In this sense, approximation by hnear mappings is as good as approximation by 
nonhnear mappings. In this paper, 'a x 6' always means that both quantities 
can be uniformly bounded by a constant multiple of each other. Likewise, 
' < ' indicates inequality up to constant factors. 

• Theorem 4: Assume that S : H~^{Q) — >■ i?o(^) is an isomorphism, with no 
further assumptions. Then we have for all C > 1 

In this sense, approximation by linear mappings is as good as approximation 
by nonlinear mappings. 

Theorem 5: If we allow only function evaluations instead of general linear 
information, then the order of convergence drops down from n~^/'^ to n^^~^'>/^^ 
where t > s + d/2. 

• In Theorem 6 and 7 we study the Poisson equation and the best n-term 
wavelet approximation. Theorem 6 shows that best n-term wavelet approx- 
imation might be suboptimal in general. Theorem 7, however, shows that for a 
polygonal domain in best n-term wavelet approximation is almost optimal. 

Some of these results (Corollary 1, Theorem 4) might be surprising since there is 
a widespread believe that nonlinear approximation is better than approximation by 
linear operators. Therefore we want to make the following remarks concerning our 
setting: 

• We allow arbitrary linear operators Sn with rank n, not only those that are 
based on a uniform refinement. 

• We consider the worst case error with respect to the unit ball of a Hilbert 
space. 

• Our results are concerned with approximations, not with their numerical re- 
alization. For instance, the construction of an optimal linear method might 
require the precomputation of a suitable basis (depending on A), which is 
usually a prohibitive task. See also Remark 10, where we discuss in more de- 
tail why nonlinear approximation is very important for the approximation of 
elliptic problems. 
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In another paper (in progress) we continue this work under the assumption 
that F is a general Besov space. Then it turns out that for some parameters 
nonhnear approximation is essentially better than linear approximation. 



2 Basic Concepts of Optimality 

2.1 Classes of Admissible Mappings 
Nonlinear Mappings Sn 

We will study certain approximations of S based on Riesz bases, cf., e.g., Meyer [26, 
page 21]. 

Definition 1. Let H be a Hilbert space. Then a sequence hi,h2, ■ ■ ■ of elements of 
H is called a Riesz basis for H if there exist positive constants A and B such that, 
for every sequence of scalar s cci, a2, ■ ■ ■ with ccj 7^ for only finitely many i, we have 



(4) a(^y. ^ II E ^^IL ^ ^ ( E I'^^i') 

k k k 

and the vector space of finite sums ^ ak hk is dense in H . 

Remcirk 2. The constants A, B reflect the stabihty of the basis. Orthonormal bases 
are those with A — B — 1. Typical examples of Riesz bases are the biorthogonal 
wavelet bases on R*^ or on certain Lipschitz domains, cf. Cohen [1, Sect. 2.6, 2.12]. 

In what follows 

(5) B = {hi\ien} 

will always denote a Riesz basis of H and A and B will be the corresponding optimal 
constants in (4). We study optimal approximations Sn oi S — of the form 

n 

(6) Snjf) = Un = y^Cfc/ljfe, 

fe=l 

where / = A{u). Assuming that we can choose B, we want to choose an optimal 
basis B. What is the error of such an approximation Sn and in which sense can we 
say that B and Sn are optimal? 

It is important to note that optimality of Sn does not make sense for a single u: 
we simply can take a B where hi is a multiple of u, and hence we can write the exact 



1/2 
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solution u as Ui = Cihi, i.e., with n = 1. To define optimality of an approximation 
Sn we need a suitable subset of G. We consider the worst case error 

(7) e(S^,F,H):= sup \\A-\f) - SM\\h, 

II/IIf<i 

where F is a normed (or quasi-normed) space, F d G. For a given basis B we 
consider the class Nn{B) of all (linear or nonlinear) mappings of the form 

n 

(8) Sr^if) = Y,Ckh,,, 

k=l 

where the and the depend in an arbitrary way on /. Optimality is expressed 
by the quantity 



(j„(^-V,B)^:=.mf inf ||^-^(/) - V /i,J|h ■ 

ll,...,l„ Cl,...Cn ' 

fc=l 

This reflects the best n-term approximation of A^^{f). This subject is widely stud- 
ied, see the surveys [6] and [37] . Since Sn is arbitrary, one immediately obtains 

inf sup \\A-\f) - SMWh = sup inf ||^-^(/)-5„(/)||^, 

SneAfniB) \\f\\p<l ||/||f<1 ■^r.(^^r.{B) 

= sup an{A~^f,B)H . 

\\f\\F<l 

We allow the basis B to be chosen in a nearly arbitrary way. It is natural to 
assume some common stability of the bases under consideration. For a real number 
C > 1 we define 

(9) Bc:^[B : B/^ < c}. 
We define the nonhnear widths ej^°g(5', F, if) as 

(10) e-S(5, F, H) = inf inf e(5., F, H). 

BeBc SneAfn{B) 

These numbers are the main topic of our analysis. They could be called the errors 
of the best n-term approximation (with respect to the collection Be of Riesz basis 
of H), for brevity we call them nonlinear widths. In this paper we investigate the 
numbers e°°^(5', F, H) only when H is a, Hilbert space. More general concepts are 
introduced and investigated in [37]. 

Remcirk 3. It should be clear that the class Nn{B) contains many mappings that 
are difficult to compute. In particular, the number n just reflects the dimension of 
a nonlinear manifold and has nothing to do with computational cost. Since we are 
interested in lower bounds, our results are strengthened by considering such a large 
class of approximations. 
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Remark 4. It is obvious from the definition (10) that S* £ J\fn{B) can be optimal 
for a given basis B in the sense that 

e(S:,F,H)^ ini e{Sr.,F,H), 

although the number e^^{S, F, H) is much smaller, since the given B is far from 
being optimal. See also Remark 10. 

Lineeir Mappings S'„ 

Here we consider the class of all continuous linear mappings Sn F ^ H , 

n 

(11) SM = J2Li(f)-hi 

i=l 

with arbitrary hi e H. For each Sn we define e{Sn, F, H) by (7) and hence we can 
define the worst case error of optimal linear mappings by 

(12) e'^{S,F,H)^ mi e{Sr,,F,H). 

The numbers eJ^°(S', F, if) (or slightly different numbers) are usually called approx- 
imation num,bers or linear widths oi S : F ^ H, cf. [24, 33, 34, 38]. 

If F is a space of functions on a set Q such that function evaluation / i— >■ f{x) is 
continuous, then one can define the linear sampling numbers 

(13) g':^{S,F,H)^ M e{Sr.,F,H), 
where vC^**^ C Cn contains only those Sn that are of the form 

n 

(14) 5„(/) = ^/(xO-/ii 

1=1 

with Xi e Q. For the numbers g^^^ we only allow standard information, i.e., function 
values of the right-hand side. The inequahty g^^^iS, F, H) > €^''{3, F, H) is trivial. 
One also might allow nonlinear Sn — (Pn ° with (linear) standard information 
Nn{f) — {f{xi), . . . , f{xn)) and arbitrary : R" — > H. This leads to the sampling 
numbers gn{S, F, H). 

Continuous Mappings Sn 

Linear mappings Sn are of the form Sn — (pn ° where both : F — > R" and 
: R" — > if are linear and continuous. If we drop the linearity condition, then 
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we obtain the class of all continuous mappings C„, given by arbitrary continuous 
mappings Nn : -F — > and : — >■ H. Again we define the worst case error of 
optimal continuous mappings by 

(15) er\S, F, H) = inf e(5„, F, H). 

These numbers, or variants of same, were studied by different authors, cf. [7, 8, 
10, 24]. Sometimes these numbers are called manifold widths of S, see [8]. The 
inequalities 

(16) el2iS,F,H)<e':\S,F,H) 
and 

(17) e^:-\S,F,H)<e'^{S,F,H) 
are, of course, trivial. 

2.2 Relations to Bernstein Widths 

The following quantities are useful for the understanding of e^^^ and e°°". 

Definition 2. The number bn{S, F, H), called the n-th Bernstein width of the opera- 
tor S : F ^ H , is the radius of the largest (n + l) -dimensional ball that is contained 
m 5({||/|k<l}). 

Remark 5. In the literature there arc used different definitions of Bernstein widths. 
E.g. in Pietsch [32] the following version is given. Let X„ denote subspaces of F of 
dimension n. Then 

K{S, F, H) := sup inf . 

X„cF^^^",Xy^O \\x\\f 

As long as S is an injective mapping we obviously have bn{S, F, H) — bn+i{S, F,H). 

As it is well-known, Bernstein widths are useful for the proof of lower bounds, see 
[7, 10, 34]. The next lemma is certainly known. Since we could not find a reference, 
we include it with a proof. 

Lemma 1. Let n e N and assume that F <Z G is quasi-normed. Then the inequality 

(18) bn{S,F,H)<er\S,F,H) 
holds for all n. 
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Proof. We assume that i^dH/H/,- < 1}) contains an (n + l)-dimensional ball B G H 
of radius r. We may assume that the center is in the origin. Let : F — 
be continuous. Since S^^{B) is an {n + l)-dimensional bounded and symmetric 
neighborhood of 0, it follows from the Borsuk Antipodality Theorem, see [5, par. 4], 
that there exists an / G dS~^{B) with iV„(/) = Nn{—f) and hence 

Snif) = Vn{NM) = MNn{-f)) = 

for any mapping : R" ^ G. Observe that = 1. Since \\S{f) — S'(— /)|| = 2r 

and Snif) = Sn{—f), we find that the maximal error of Sn on {±/} is at least r. 
This proves 

bniS,F,H)<er\S,F,H). 

□ 

We will see that the 6„ can also be used to prove lower bounds for the e^^°Q. As 
usual, Co denotes the Banach space of all sequences x — {xj)°^i of real numbers such 
that \imj_^^Xj — and equipped with the norm of 

Lemma 2 below has a long history since it is central in the theory of s-numbers. 
See [33, Lemma 2.9.6], where also its use for proving a result as Lemma 3 is exhibited. 

Lemma 2. Let V denote an n- dimensional subspace of Cq. Then there exists an 
element x E V such that \\x\\^ = 1 and at least n coordinates of x = {xi,X2, ■ ■ .) 
have absolute value 1. 

Lemma 3. Let be an n- dimensional subspace of the Hilbert space H. Let B be a 
Riesz basis with Riesz constants Q < A < B < oo. Then there is a nontrivial element 
X such that x — Y^^=i ^'^^ 

A^/n\\{xj)j\\^ < \\x\\h- 

Proof. Associated with any x & H there is a sequence {xj)j of coefficients with 
respect to B that belongs to cq. In the same way, we associate with Vn d H a 
subspace C Cq, also of dimension n. As a consequence of Lemma 2, we find an 
element {xj)j e such that 

< \xj^ 

This implies 

\\x\\h > A{J2 = A^\\{x,),\\^. 

1=1 

□ 



9 



Theorem 1. Assume that F d G is quasi-normed. Then 
(19) el^^{S,F,H) > ^b^{S,F,H) 

holds for all m > 4C^n. 

Proof. Let B he a Riesz basis with Riesz constants A and B and let m > n. Assume 
that >S'({||/|| < 1}) contains an m-dimensional ball with radius e. Using Lemma 
3, there exists an a; G i^dH/H < 1}) such that x = ^.iXihi, \\x\\ = e and \xi\ < 
A~^ m~^^'^£ for all i. Let Xi, . . .Xn be the n largest components (with respect to the 
absolute value) of x. Now, consider y — Y^- yi hi such that at most n coefficients are 
nonvanishing. Then 

\\x - vWh > Mi^i - yi)i\\2 

and the optimal choice of y (with respect to the right-hand side) is given by y'^, 
where yi = Xi, . . . ,y^ = Xn- Now wc continue our estimate 



A\\{xi-yi)i\\2 > A{\\{xi),\\2-\\{y 



i i\\2 



The right-hand side is at least £^4/(25) if m > AB'^n/A^. □ 

Remark 6. Probably the constant 1/(2C) is not optimal. But it is obvious from 

(20) that for m tending to infinity the constant is approaching A/B. 

2.3 The Case of a Hilbert Space 

Now let us assume, in addition to the assumptions of the previous subsections, that 
F C G is a Hilbert space. The following result is well known, see [32] and Remark 5. 

Theorem 2. Assume that F is a Hilbert space. Then 

(21) e'^{S, F, H) = eT{S, F, H) = h^{S, F, H). 

In many applications one studies problems with "finite smoothness" and then, as 
a rule, one has the estimate 

(22) b2n(S,F,H):<bn(S,F,H). 

Formula (22) especially holds for the operator equations that we study in Section 3. 
Then we conclude that approximation by optimal linear mappings yields the same 
order of convergence as the best n-term approximation. 

Corollary 1. Assume that S : F H with Hilbert spaces F and H , with (22) 
holding. Then 

(23) e'^{S, F, H) = 6^(5, F, H) x e'^^iS, F, H). 
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3 Elliptic Problems 



In this section, we study the more special case where Q C R*^ is a bounded Lipschitz 
domain and A — : i?o(^) ~^ H~^{Q) is an isomorphism, where s > 0. The 
first step is to recall the definition of the smoothness spaces that are needed for our 
analysis. 



3.1 Function Spaces 

If m is a natural number, we let H"^{Q) denote the set of all functions u G i>2(f2) 
such that the (distributional) derivatives D'^u of order |q;| < m also belong to L2{fl). 
This set, equipped with the norm 

II 1* ||i?'"(n) ^ II 11^2(0)) 

\a\<m 

becomes a Hilbert space. For a positive noninteger s, we define H^{Q) as specific 
Besov spaces, li h E W^, we let Qh denote the set of all x e Q such that the line 
segment [x,x + h] is contained in Q. The modulus of smoothness uJr{u,t)L^(^Q) of a 
function u e Lp{ft), where < p < oo, is defined by 

(^r{u,t)L^^n) ■■= sup ||A;;(m, ■)\\L^(a^^), t > 0, 

\h\<t 

with the r-th difference with step h. For s > and < q,p < oo, the Besov 
space B^{Lp{Q)) is defined as the space of all functions u e Lp{Q) for which 

{J^[t-'Ur{u, t)L,(^n)Ydt/ty''' , < g < OO, 



(24) \u\Bs(L,{a)) :-- 



is finite with rEN,s<r<s + l, see, e.g., [40] for details. It turns out that 
(24) is a (quasi-) semi-norm for B'^{Lp{Q)) . If we add ||'u||Lp{n) to (24), we obtain a 
(quasi-)norm for B^{Lp{fl)) . Then, for positive noninteger s, we define 

H'{n) := S|(L2(Q)). 

It is known that this definition coincides up to equivalent norms with other defini- 
tions based, e.g., on complex or real interpolation, cf. Dispa [9], Lions and Magenes 
[23, Vol. 1] and Triebel [41]. 

For all s > we let Hq{Q) denote the closure of the test functions V{Q) in H^{fl). 
Finally, we put 
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where k G Nq. Alternatively (and this is done e.g. in [19] and will play a role in 
Subsection 3.5) one could use the following approach: define for s > 

:= |ii e L2(fi) : there exists g e H^{M.^) with ^ u and suppsicnj 
equipped with the induced norm. Then, for all s > 0, s 7^ | + /c, /c G N 

in the sense of equivalent norms, of. Grisvard [14, Cor. 1.4.4.5]. If < s = | + /c, 
A; e N, then we put 

(25) H-'{n) := (H'{n)J . 

Observe, that by the previous remark this could be used as definition for all values 
of s > (up to equivalent norms). 

Since we have Hilbert spaces, linear mappings are (almost) optimal approximations, 
i.e., Corollary 1 holds. We want to say more about the structure of an optimal linear 
Sn for the approximation of 5" = A~^. For this, the notion of a "regular problem" is 
useful. 

3.2 Regular Problems 

The notion of regularity is very important for the theory and the numerical treatment 
of operator equations, see [16]. We use the following definition and assume that t > 0. 

Definition 3. Let s > 0. An isomorphism A : Hq[Q) — > H~^[Q) is iJ^+^-regular if 
also 

(26) A : H^in) n //^+*(Q) ^ i/-^+*(Q) 
is an isomorphism. 

A classical example is the Poisson equation in a C°°-domain: this yields an opera- 
tor that is i/^+*-regular for every t > 0. We refer, e.g., to [16] for further information 
and examples. It is known that in this situation we obtain the optimal rate 

(27) el^'iS, //-^+*(Q), H'{^})) X n-*/*^ 

of hnear methods. This is a classical result, at least for t,s E N and for special 
domains. We refer to the books [11, 31, 43] that contain hundreds of references. 

We prove that the rate (27) is true for arbitrary s, t > 0, and for arbitrary bounded 
(nonempty, of course) Lipschitz domains. The optimal rate can be obtained by using 
Galerkin spaces that do not depend on the particular operator A. With nonlinear 
approximations we cannot obtain a better rate of convergence. 
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Theorem 3. Assume that the problem is H^'^'^ -regular. Then for all C > 1, we have 

(28) e|i°(5, H-'+\Q), H'{n)) x el'^^iS, H-'+\n), H'{Q)) x n''^'^ 

and the optimal order can be obtained by subspaces of that do not depend on the 
operator S = . 

Proof. Consider first the identity (embedding) I : if*+*(Q) — > H^{Q). It is known 
that 

e^"(7, H'+'{n), H'{n)) X n-'/'^. 

This is a classical result (going back to Kolmogorov (1936), see [22]) for s, t e N, see 
also [34]. For the general case {s,t > and arbitrary bounded Lipschitz domains) 
see [12] and [41]. We obtain the same order for I : H'+^Q) n H^{n) H'{n). 

We assume (26), and hence S : if~*+*(Q) — > i7*+*(Q) ni7o(f^) is an isomorphism. 
Hence we obtain the same order of the ejj° for I and for I o S\H-''+t{fi)- Together with 
Corollary 1 this proves (28). 

Assume that the linear mapping 

n 

1=1 

is good for the mapping I : if*+*(Q) fl Hq{Q) — > if*(Q), i.e., we consider a sequence 
of such approximations with the optimal rate n"*^'^. Then the linear mappings 

n 

1=1 

achieve the optimal rate n"*/'^ for the mapping S : if~*+*(Q) if*+*(Q) C if*(Q). 

□ 

Remcirk 7. The same Qi are good for all iJ*''"*(n)-regular problems on H~^~^^{il); 
only the linear functionals, given by o S^^-s+k, depend on the operator A. For the 
numerical realization we can use the Galerkin method with the space Vn generated 
by gii, . . . , gr„. It is known that for one can take spaces that are based on uniform 
refinement, e.g., constructed by uniform grids or uniform finite elements schemes. 
Indeed, if we consider a sequence Vn of uniformly refined spaces with dimension n, 
then, under natural conditions, the following characterization holds: 




see, e.g, [3, 30] and the references therein. 
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Remark 8. Observe that the assumptions of Theorem 3 are rather restrictive. 
Formally we assumed that O is an arbitrary bounded Lipschitz domain and that A 
is if^+^-regular. In practice, however, problems tend to be regular only if Q has a 
smooth boundary. 

3.3 Nonregular Problems 

The next result shows that linear approximations also give the optimal rate n~^^'^ 
in the nonregular case. An important difference, however, is the fact that now the 
Galerkin space must depend on the operator A. Related results can be found in 
the literature, see [21, 25, 42]. Again we allow arbitrary s and t > and arbitrary 
bounded Lipschitz domains. We also prove that nonlinear approximation methods 
do not yield a better rate of convergence. 

Theorem 4. Assume that S : H~^{Q) — HQ^fl) is an isomorphism, with no further 
assumptions. Here Q, (Z is a bounded Lipschitz domain. Then we have for all 
C> 1 

(30) e'^{S, H-^+\n), H^{n)) X e-5(5, H-^+\n), H^{n)) X n-'/'. 

Proof. Consider first the identity (or embedding) / : H~^^^{Q) — > H~^{Q). It is 
known that 

el''{I,H-'+\Q),H-'{Q)) X n"*/"^. 

Again this is a classical result, for the general case (with s,t > and fl an arbitrary 
bounded Lipschitz domain), see [41]. 

We assume that S : H^''^{Q) ^[^{Q) is an isomorphism, so that ej"' have the 
same order for / and for 5*0/. Together with Theorem 1 and Corollary 1, this proves 

(30) . 

Assume that the linear mapping 

n 
1=1 

is good for the mapping I : H~^~^^ H^^, i.e., we consider a sequence of such 
approximations with the optimal rate n"*/*^. Then the linear mappings 

n 

(31) J2^(9^)L^{f) 

i=l 

achieve the optimal rate n~^^'^ for the mapping S : H~^~^^{Q) H^(Q). □ 
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Remark 9. It is well-known that uniform methods can be quite bad for problems 
that are not regular. Indeed, the general characterization (29) implies that the ap- 
proximation order of uniform methods is determined by the Sobolev regularity of 
the solution u. Therefore, if the problem is nonregular, i.e., if the solution u lacks 
Sobolev smoothness, then the order of convergence of uniform methods drops down. 

Remcirk 10. For nonregular problems, we use linear combinations of S{gi). The 
Qi do not depend on S, but of course the S{gi) do depend on S. This has impor- 
tant practical consequences: if we want to realize good approximations of the form 

(31) then we need to know the S{gi). Observe also that in this case we need good 
knowledge about the approximation of the embedding / : H~^~^^[fl) H~^[fl). For 
s > 0, this embedding is not often studied in numerical analysis. 

Hence we see an important difference between regular and arbitrary operator 
equations: Yes, the order of optimal linear approximations is the same in both cases 
and also nonlinear (best n-term) approximations cannot be better. But to construct 
good linear methods in the general case we have to know or to precompute the S{gi), 
which is usually almost impossible in practice or at least much too expensive. 

This leads us to the following problem: Can we find a i3 G Be (here we think 
about a wavelet basis, but we do not want to exclude other cases) that depends only 
on t, s, and fl such that 

(32) inf e(5„, //-+*(Q), H%Q)) x n''/' 

for many different operator equations, given by an isomorphism S — : H~^{ft) — > 

We certainly cannot expect that a single basis B is optimal for all reasonable 
operator equations, but the results in Section 3.5 indicate that wavelet methods seem 
to have some potential in this direction. In any case it is important to distinguish 
between "an approximation S'„ is optimal with respect to the given basis B" and 
"Sn is optimal with respect to the optimal basis B" . See also [27] and [29]. 



3.4 Function Values 

Now we study the numbers gn{S, H^-%n), H%n)) = g^Ji'^iS, H^-'{n), H%n)) under 
similar conditions as we had in Theorem 4. In particular we do not assume that the 
problem is regular. However we have to assume t > s + d/2 so that function values 
will continuously depend on / e i?*~*(Q). 

Consider first the embedding I : if*(Q) — > -L2(J1), where Q is a bounded Lipschitz 
domain Q C R*^. We want to use function values of / e if*(Q) and hence have to 
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assume that t > d/2. It is known that 

(33) e'^il, H\Q), L,iQ)) x ^^°(7, H^Q), L.iQ)) x n''/', 

see [28] . This means that arbitrary hnear functionals do not yield a better order of 
convergence than function values. Observe that we always have gn = ^f^", since we 
consider mappings between Hilbert spaces and hence the linear spline algorithm is 
always optimal, sec [39, 4.5.7]. 

It is interesting that for s > arbitrary linear information is superior to func- 
tion evaluation. In the theorem that follows, we make no smoothness or regularity 
assumptions. 

Theorem 5. Assume that S : H~^{0,) — > Hq{Q) is an isomorphism, where Q cW^ 
is a bounded Lipschitz domain. Then 

(34) g^{S, H-^+\n), H%n)) = gl^{S, H-^+\n), H%n)) x n^^-*)/^ 
fort > s + d/2. 

Proof. As in the proof of Theorem 4, it is enough to prove that 

(35) ^„(/, H-'+\n), H-'{n)) X n^'-'y". 

To prove the upper and the lower bound for (35), we use several auxiliary problems 
and start with the upper bound. It is known from [28] that 

^„(/,i/-+*(0),L2(0))xn(-*)/'^. 

provided that t — s > d/2. Prom this we obtain the upper bound 

gn{I, H-'-^\Q), H-'{n)) < c ■ n^^-*)/'^ 

by embedding. 

For the lower bound we use the bound 

(36) ^„(7,//-+*(Q),Li(Q))xn(-*)^ 

again from [28]. The lower bound in (36) is proved by the technique of bump func- 
tions: Given Xi. . . . ,Xn G il, one can construct a function / e H~^^*'{Vt) with norm 
one such that f{xi) — ■ ■ ■ — f{xn) = and 

(37) ll/IU. >c-n(-*)^ 
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where c > does not depend on the Xi or on n. The same technique can be used to 
prove lower bounds for integration problems. We consider an integration problem 

(38) Int(/)= / fadx, 

Jn 

where cr > is a smooth (and nonzero) function on Q with compact support. 
Then this technique gives: Given xi, . . . ,Xn £ ^, one can construct a function / e 
if~''+*(Q) with norm one such that f{xi) — ■ ■ ■ — f{xn) — and 

(39) Int(/) > c • n("-*)/^ 

where c > does not depend on the Xi or on n. Since we assumed that a is smooth 
with compact support, we have 

||/b-^>c-|Int(/)| 
and hence we may replace in (39) Int/ by H/Hh-^, hence 

□ 

3.5 The Poisson Equation 

Finally we discuss our results for the specific case of the Poisson equation 

(40) -Au = / in n 

u — Q on do. 

on a bounded Lipschitz domain Vt contained in M'^, d > 2. Here, as always in this 
paper, we understand Lipschitz domain in the sense of Steins notion of domains 
with minimal smooth boundary, cf. Stein [36, VI. 3]. 

It is well-known that (40) fits into our setting with s = 1. Indeed, if we consider 
the weak formulation of this problem, it can be checked that (40) induces a bound- 
edly invertible operator ^ = A : i?o(f2) — > H~^{Q), see again [16, Chapter 7.2] 
for details. 

In this section, we shall especially focus on wavelet bases ^ — {i/jx : A e J}. The 
indices \ ^ J typically encode several types of information, namely the scale (often 
denoted |A|), the spatial location and also the type of the wavelet. Recall that in a 
classical setting, a tensor product construction yields 2^—1 types of wavelets [26] . 
For instance, on the real line A can be identified with (j', k\ where j = |A| denotes 
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the dyadic refinement level and 2^^k signifies the location of the wavelet. We will 
not discuss at this point any technical description of the basis ^. Instead we assume 
that the domain Q under consideration enables us to construct a wavelet basis ^' 
with the following properties: 

• the wavelets are local in the sense that 

diam(suppV'A) ^ 2~l^l, X e J; 

• the wavelets satisfy the cancellation property 

\{v,^x)\ < 2-l^l™||t;||^™(3,pp^^), 
where m denotes some suitable parameter, and 

• the wavelet basis induces characterizations of Besov spaces of the form 

/ ^ / \ "/A 



(41) 



S|(Lp(0)) 



where s > d (^^ — ij and ^ = {■0a '■ X G J} denotes the dual basis 

For the applications we have in mind, especially the case p — q,p < 2,1/p < 
s/d+ 1/2 is important, see, e.g.. Theorem 6 for details. 

By exploiting the norm equivalence (41) and using the fact that S|(L2(J1)) = 
if*(Q), a simple rescahng immediately yields a Riesz basis for H^. We shall also 
assume that the Dirichlet boundary conditions can be included, so that a character- 
ization of the form(41) also holds for Hq{0,). We refer to [1] for a detailed discussion. 
In this setting, the following theorem holds. 

Theorem 6. Let S denote the solution operator for the problem (40). Then, for 
sufficiently large C , best n-term wavelet approximation Sn yields 



el^fSiS,H'-\Q),H\Q)) < e{S^, H'-\Q), H\Q)) 



n d 



+e 



if 0<t<l/2, 



< c < 



_(t+i) 
n 3d 



if ^<t< 



d+2 
2{d-l) 



^ 2d(d-l)+^ 

where e > is arbitrary and c does not depend on n 



if d+2 ^ 
y 2{d-l) ^ ^ ' 
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Proof. Step 1. All what we need from the wavelet basis is the following estimate for 
the best n-term approximation in the if^-norm: 

(42) II u - SM \\h^ < c \u\B,^iLMn)) n^""-'^/', ^ = + ^, 

see, e.g., [3] for details. We therefore have to estimate the Besov norm i?°^(L^*(0)). 
Step 2. Besov regularity of u. 

First of all, we estimate the Besov norm of u in the specific scale 

(43) B^^{L,{n)), where - = ^ + J- 

T a Z 

Regularity estimates in the scale (43) have already been performed in [4] . We write 
the solution u to (40) as 

U = U + V, 

where u solves —Au = / on a smooth domain Q D Jl. Here / = £{f) where £ 
denotes some suitable extension operator with respect to Furthermore, v is the 
solution to the additional homogeneous Dirichlet problem 

(44) At; = in Q 

V — g — — Tr('u) on dfl . 

Substep 2.1 Regularity of u. Let t > 0. Let £^ be a bounded linear extension operator 
from Bl-^{L2{9)) S*-^(L2(M<=^)), cf. [35]. Then, by classical elliptic regularity 
on smooth domains, cf. e.g. [19, Thm. 0.3], it follows from £f e B^^[L2{Vt)) that 
u e Bl+\L2{h)) and 

II ^ llB*+i(L2(f2)) - ^1 ll^ll \\f\\Bl-\L2m ■ 

Known embeddings of Besov spaces yield 

(45) II U ||^t+i-e(j-_^(f^)) < C2 II M \\bI+\l^{Q)) < C3 II M \\Bl+\L2m ^ f \\ j^t-i ^^^^^^-^^ , 

where < g < 2 and £ > are arbitrary. 

Substep 2.2 The regularity of v. An important theorem of Jerison and Kenig, see 
[17, 18] and also [19, Thm. 5.1] (for d > 3), reads as 

(46) II V \\Bi(L,m ^ C5 N \\Br'^\L,(dn)y 1/2 < ^ < 3/2 . 

Trace problems for Lipschitz boundaries are investigated in [20]. We refer to this 
monograph and to [19] also for the exact meaning of Tr and i?|(L2(c?0)), respectively. 
Theorem 2 on page 209 in [20] and (46) yield 

II 'V ||B|(L2{n)) < C5 II Tr || || U ||b|(z,2(o)) <Cfi\\u \\Bl+\L2m ^ C7||/||Bt-i(i2(n)) , 
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if 1/2 < ^ < 3/2 and^ < t+1. Consequently f G 5|(L2(fi)) with^9 < min(3/2, 

A harmonic function in a bounded Lipschitz domain has a higher Besov regularity 

than Sobolev regularity. More precisely, 

veB-iLA^)). 0<.<J^, i = l + l, 

and 

II V ||B.(L,(n)) < cs II -y ||B|(L2(n)) > 
see [4]. Combining this with (45) we arrive at 

(47) ueB^iLrm, 0<s<min(^,i + l), ^ = ^ + 
together with the estimate 

lkl|B|(L,{n)) < ||it||B|(L,{n)) + lkl|B|{L,{n)) < C9||/||ij*-i(L2(n))- 

Substep 2.3 An interpolation argument. Another theorem of Jerison and Kenig, see 

[19, Thm. 0.5], yields 

(48) 

u e B^{L2{n)) , s < min(3/2,t + 1) , where ||M||s|(L2(n)) < Cio||/||st-i(L2(n))- 
Thanks to the real interpolation formula 

(B;i{Lp,{Q)),B;i{L,^{n))) = B;{Lp{fl)) , (equivalent quasi-norms) , 

o<e<i, s = (i-e)so + esi, 1 = 1:1^ + -^, 

P Po Pl 

valid for all sq, si e IR and all < po,Pi < oo, of. [41], we can combine these 
two different assertions (47), (48) about the regularity of u. Let e.g. 1/2 < t < 
{d + 2)/ {2d — 2). Then we use the interpolation formula with 

So — 3/2 — e, Si = t + 1 , and 6 = 1/3, 

and find that u e B^.{Lr*{n)), s = 1 + {t + l)/3 - e' , l/r* = {s-l)/d+l/2, where 

lkl|BJ.(L,.(Q)) < Cll||/||Bt-i(i,2(n)), 

and e' can be made as small as we want. In summary, we have 

sup \\u-Sn{f)\\H^<C,2n-^*-^+'\ 

The other two cases can be treated in an analoguous way. We omit details. □ 
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Theorem 6 shows that best n-term wavelet approximation might be suboptimal 
in general. However, for more specific domains, i.e., for polygonal domains, much 
more can be said. Let Q denote a simply connected polygonal domain contained 
in M^, the segments of dfl are denoted by Ti,Ti open, / = 1, . . . , numbered in 
positive orientation. Furthermore, T; denotes the endpoint of Ti and Ui denotes the 
measure of the interior angle at T^. Then the following theorem holds: 

Theorem 7. Let S denote the solution operator for the problem (40) in a polygonal 
domain in . Let k be a nonnegative integer such that 

77777- 

ky^ for all me N, l^l,...,N. 

Then, for sufficiently large C , best n-term wavelet approximation Sn yields 

(49) el°'^iS,H''-\n),H\n)) < e{Sn, H''-\n), H\n)) < Cn-'=/^+% 
where e > is arbitrary and C does not depend on n. 

Proof. The proof is based on the fact that u can be decomposed into a regular part 
ur and a singular part us-, u = ur + us, where ur E i?2^^(L2(f2)) and us only 
depends on the shape of the domain and can be computed explicitly. This result 
was estabhshed by Grisvard, see [13] or [14, Chapt. 4, 5], and [15, Sect. 2.7] for 
details. We introduce polar coordinates (r^, 9i) in the vicinity of each vertex T; and 
introduce the functions 

Si,m{rhOi) = 0(n)?^^"sin(m7r6'i/u;,), 

when Xi^rn '■— rmi/uji is not an integer and 

Si,m{rh 0i) = Ci{ri)ri''"[logri sm{m7rei/ui) + Oi cos{m7rei/u}i)] 

otherwise, m E N, I = 1, . . . N. Here Q denotes a suitable C°° truncation function. 
Then for / e H''-\Q) one has 

N 

(50) = ^ ^ Ci^rnSl,m, 

l=\ 0<A;,^<fc 

provided that no Xi^m is equal to k. This means that the finite number of singularity 
functions that is needed depends on the scale of spaces we are interested in, i.e., 
on the smoothness parameter k. According to (42), we have to estimate the Besov 
regularity of both, us and ur, in the specific scale 
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Since ur G i^g"'' (-^2(^)), classical embeddings of Besov spaces imply that 

(51) ur e B^+^-'' {Lr,{n)) J_ ^ (fe-g) ^1 for arbitray small e' > 0. 

T* a 2 

Moreover, it has been shown in [2] that the functions Si^^ defined above satisfy 

(52) Si,m{ri,9i)eB^,{L,4n)), 1 = 1^^ + 1 for all a > 0. 
By combining (51) and (52) we see that 

u e B'^t^-'' {Lr,{n)) J_ ^ - g') ^ 1 for arbitray small e' > 0. 

To derive an estimate uniformly with respect to the unit ball in H''~^{D,) we argue 
as follows. We put 

TV := span |cSz,,„(r/, Oi) : < A^,; < A; , / = 1, . . . , A^j . 

Let 7; be the trace operator with respect to the segment F;. Grisvard has shown 
that A maps 



H 



onto ^(^)) cf. [14, Thm. 5.1.3.5]. This mapping is also injective, see [14, Lemma 4.4.3.1, 
Rem. 5.1.3.6]. We equip the space H with the norm 

N 

\\u\\h ■= \\ur + Us\\h = \\uR\\Hk+i(^a)+^ ^ \ci,m\, 

1=1 0<Xi,^<k 

see (50). Then it becomes a Banach space. Furthermore, A is continuous. Banach's 
continuous inverse theorem implies that the solution operator is continuous consid- 
ered as a mapping from H''~^{fl) onto H. Observe 



N 

ur + US \\Bk^+^--'iLr4n)) ^ (ll ^-R \\B^+\L,{n)) + Y1 '^'■'"l) 

1=1 Q<Xl^rn<k 



with some constant C independent of u. □ 
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